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Abstract 

In (3, it was conjectured that the permanent of a P-lifting (E p of a matrix 9 of degree M is less than or equal to the 
Mth power of the permanent perm($), i.e., perm(#^ p ) < perm(#) M and, consequently, that the degree-M Bethe permanent 
perm M B (9) of a matrix 9 is less than or equal to the permanent perm(0) of 9, i.e., perm M B (0) ^ perm($). In this paper, we 
prove these related conjectures and show in addition a few properties of the permanent of block matrices that are lifts of a matrix. 
As a corollary, we obtain an alternative proof of the inequality perm B ( 9 ) ^ perm(0) on the Bethe permanent of the base matrix 
9 that uses only the combinatorial definition of the Bethe permanent (the first proof was given by Gurvits in {21). 

Index Terms 

Bethe free energy, Bethe permanents, permanents, matrix lifts, protographs. 


I. Introduction 

A. Permanents and Bethe permanents 

T HE concept of the Bethe permanent was introduced in 0, 0 to denote the approximation of a permanent of a non¬ 
negative matrbiQ by solving a certain minimization problem of the Bethe free energy with the sum-product algorithm. In 
his paper [0, Vontobel uses the term Bethe permanent to denote this approximation and provides reasons why the approximation 
works well by showing that the Bethe free energy is a convex function and that the sum-product algorithm finds its minimum 
efficiently. Although its definition looks simpler than that of the determinant, the permanent does not have the properties of 
the determinant that enable efficient computation 131, 0. Whereas the arithmetic complexity (number of real additions and 
multiplications) needed to compute the determinant is in 0(n 3 ), Ryser’s algorithm, one of the most efficient known algorithms 
for computing the permanent, requires (-)(«■ 2") arithmetic operations [f7j. This clearly improves upon the brute-force complexity 
0(n ■ n\) = 0(n 3 / 2 • ( n/e ) n ) for computing the permanent, but it is still exponential in the matrix size. In terms of complexity 
classes, the computation of the permanent is in the complexity class jjP [8], where jjP is the set of the counting problems 
associated with the decision problems in the class NP. Even the computation of the permanent of 0-1 matrices restricted to 
have only three ones per row is jjP-complete (9). However, for circulant matrices, one can exactly calculate the permanent in 
polynomial time ItTOll — lfl3ll . Later these results were strengthened in various ways in [fT4l — j 1 7| . In contrast to the permanent, 
the Bethe permanent can be computed efficiently (i.e., in polynomial time). 

In the recent paper ED, Gurvits shows that the permanent of a matrix is lower bounded by the Bethe permanent of that matrix, 
perm B (0) ^ perm(0), and discusses conjectures on the constant C in the inequality perm(0) ^ C ■ perm B (0). Also, in fl8l . 
Ruozzi showed an analogous result for log-supermodular graphical models. Related to these results, Vontobel m formulates 
a conjecture that the permanent of an M -lift (d p of a non-negative matrix 9 is less than or equal to the Mth power of the 
permanent perm(d), i.e., perm(6d p ) ^ perm(d) M , and that the degree M-Bethe permanent perm M B (0) of a matrix 6 is less 
than or equal to the permanent perm(0) of 9, i.e., perm MB (0) ^ perm(0) and proves it for the particular case of 9 equal to 
the all-one matrix. A proof of his general conjecture would imply an alternative proof of the inequality perm B (d) perm(d) 
that uses only the combinatorial definition of the Bethe permanent]^ 
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2 The formal definition of the Bethe and M-Bethe permanents is given in Definition [2] 
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In this paper, we prove this conjecture in its generality. In addition, we prove certain structural properties of the permanent 
of block matrices that are lifts of a matrix; these matrices are the matrices of interest when studying the degree-M Bethe 
permanent. 

B. Related work 

The literature on permanents and on adjacent areas (of counting perfect matchings, counting 0-1 matrices with specified row 
and column sums, etc.) is vast. Apart from the previously mentioned papers, the most relevant papers to our work are the one by 
Chertkov & Yedidia J4j that studies the so-called fractional free energy functionals and resulting lower and upper bounds on the 
permanent of a non-negative matrix, the papers f 19] (on counting perfect matchings in random graph covers), j20l (on counting 
matchings in graphs with the help of the sum-product algorithrr J, and ED, ED, ED (on max-product/min-sum algorithms 
based approaches to the maximum weight perfect matching problem). Relevant is also the line of work on approximating 
the permanent of a non-negative matrix using Markov-chain-Monte-Carlo-based methods 12311 . polynomial-time randomized 
approximation schemes l24l . and Bethe-approximation based methods or sum-product-algorithm (SPA) based method 0. lt25ll Fl 


C. Paper outline 

The remainder of the paper is structured as follows. In Section II-DI we list basic notations and definitions, provide the 
necessary background, and formally define the Bethe permanent and degree-M Bethe permanent. The following Section QI| 
contains the results of this paper and consists of three subsections. In Section Hl-AI we show that the bound perrn((/' p ) sC 
perm(0 ) M is tight, i.e., for every matrix 9, there exists a P-lifting of 9 for which the bound is satisfied with equality. Sections 
III-BlUl-Gl present some useful results on the structure of the permanent of a P-lifting of degree M, (f v . Section Hl-HI contains 
the proof of the conjecture on the permanent of a matrix lifting which follows immediately from these first results, and 
Section HI-11 contains the bounding results on the Bethe permanent and the degree-M Bethe permanent. We conclude the paper 
in Section [HI] and present a few extra examples of our techniques in the appendix. 


D. Notations and definitions 

Rows and columns of matrices and entries of vectors are indexed starting at 1. For an integer M, we use the common 
notation [M] = {1,..., M}. We use the common notation hij or Hy to denote the entry of a matrix H. For a set a, 

|a| is the cardinality of a (the number of elements in the set a). The set of all M x M permutation matrices is denoted by 
Vm , and the set of all permutations on the set [to] is denoted by S m . 

Definition 1. Let 9 = (Oij) be an m x m-matrix over the integers. Its determinant and permanent, respectively, are defined to 
be 

det(0) = ^2 II > perm(0) = II > 

crG<S m i(z[m\ <x£«S m i£[ra] 

where sgn(cr) is the signature operator. 

We call the products II, G[m] a G <-> m , permanent-products of 9. □ 

The following combinatorial description of the Bethe permanent can be found in [Q. We use it here as a definition. 

Definition 2. Let 9 be a non-negative (with non-negative real entries) m x m matrix and M be a positive integer. Let be 
the set of all mM x mM matrices whose blocks are permutation matrices, i.e., 

VZ = {^ = ( Pij) | Pij G Vm, Vt G [to]}. 


For a matrix P G V'ff, the P-lifting of 9 is defined as the mM X mM matrix of weighted permutation matrices: 


0tP 4 


0ii Pi 


9mlPrr, 




3 Computing the permanent is related to counting perfect matchings. 
4 See |T] for a more detailed account of these and other related papers. 
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and the degree-M Bethe permanent of 8 is defined as 

perm BiM (6>) = ( perm(6» tP )) 1/M , 

where the angular brackets (perm(P p )) represent the arithmetic average o/perm(P p ) over all P £ Pm- 
The Bethe permanent of 8 is defined as 

perm B (0) = limsupperm BiM (0). 

M—^oo 

□ 

Since the permanent operator is invariant to the elementary operations of interchanging rows or columns, we can assume, 
when taking the permanent, without loss of generality, that matrices P £ P'f have Py = pi = Im , for all i £ [to], where 
Im is the identity matrix of size M x M. We call such matrices reduced. 

Definition 3. A matrix P = (Py ) £ Pj} is reduced if Py = Pn = Im, for all i,j £ [to]. The set of all reduced matrices P 
is denoted by P^. □ 

Remark 4. Note that a P-lifting of a matrix 8 corresponds to an M-graph cover of the protograph (base graph) described by 
8. Therefore we can consider (f p to represent a protograph-based LDPC code and 8 to be its protomatrix (also called its base 
matrix or its mother matrix) 12(3 . □ 


II. The Permanent of a Matrix-Lift 

In III, it was conjectured that for any non-negative square matrix 8 and for any P G Pj^, 

perm( 6 » tP ) < perm( 6 ») M . 

In this section we prove this conjecture and several related lemmas on the structure of the perm((P p ) of the lift (P p of the 
matrix 8, for any non-negative matrix 0. 


A. Tightness of the bound 


We start by showing that there exists at least one lifting for which the bound is tight. The following example shows a lift 
of the matrix 8 of degree 2 that has maximum permanent perm( 0 ) 2 . 

Example 5. Let 8, P G v\ and (L p as follows: 



a b c 


1 

1 _ 

8 4 

d e f 

, P 4 

I2 I2 I2 


9 h i 




(P p 


a 

0 

b 

0 

c 

0 

0 

a 

0 

b 

0 

c 

d 

0 

e 

0 

/ 

0 

0 

d 

0 

e 

0 

/ 

9 

0 

h 

0 

i 

0 

0 

9 

0 

h 

0 

i 


Equivalently, (f p = 0 ® I, where <g) denotes the Kronecker product of matrices. After row and column permutations, which 
leave the permanent invariant, the matrix (! p can be rewritten as 


a b c 

d e f 
9 h i 



a b c 


d e / 


9 h i _ 


where the empty blocks contain only zero entries. This last matrix is a block-diagonal matrix with permanent equal to the 
product of the permanents of the matrices on the diagonal, therefore 


perm( 6 ff p ) = (perm( 0 )) 2 . 
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□ 

In fact, a stronger result was shown by Brualdi in |[27l . 

Theorem 6 (Theorem 3.1, l27l ). Let 0 a non-negative matrix of size m X m and P a matrix of size M X M. Then 

perm (0 g> P) = perm (P g> 9) ^ perm(#) M perm(P )" 1 

wif/j equality if and only if P or 9 has at most one non-zero permanent-product. 

Since a permutation matrix has exactly one non-zero permanent-product, the bound holds with equality when P is a 
permutation matrix. The following corollary follows from this theorem. 

Corollary 7. Let 9 = (9 t j ) be a non-negative matrix of size to x m and let P = (I\ j ) G Vsuch that P^ = P for all 
[to], where P is a permutation matrix of size M. Then 

perm( 6 > tP ) =perm (9) M . 

This corollary applies, in particular, for P = Im, the identity matrix of size M. 


B. The exponent matrix of a permanent-product 

Let 9 = ( 9ij ) be a non-negative matrix of size m x to and P = (Pij) G 'P'm- Let r G S m M be a permutation on the set 
[mM] and let 

a t 4 n (0 tp W) 

z£[raM] 

be the permanent-product of (f p pertaining to permutation r. 

Definition 8. We say that A T is trivially zero if there exists i G [mM] such that (9^ p ) iT ^ = 0 and (d^ p ). iT ^ ^ 9ji, for all 
j , l G [to], and we say that A T is non-trivially zero if (9^ F ) iT ^ = 9ji for some j, l G [to] and 9ji =0. □ 

In the rest of the paper, all permanent-products considered will be assumed not to be trivially zero. Since for each i G [mM], 
there exist j, l G [to] such that i G {(j — 1)M + 1,..., jM} and r(z) G {(( — 1)M + 1,..., IM}, (9^ F ) iT ^ is an entry in 
the weighted permutation matrix 9jiPji of 9^ p . By the assumption that A T is not trivially zero, we have (6^ p )i T (j) = 9ji. Let 


a ji - {* G {(j - 1)M + 1,... ,jM} | r(i) G {(l - 1 )M + 1,... ,IM}} . 

T A I t I 

T jl — I a jl\- 

Then, (6^ p )j r (i) = 9ji, for all i G ap and for all j, l G [to], therefore 


( 1 ) 

( 2 ) 


jM m 

n ( 0 tp )irw= ^i 1 ^=n ^» vj g [to] . 

i=(j-l)M-\-l 1=1 

Since each row and each column of 9^ p must contribute to the product exactly once, the matrix a T = (cx^i)j,i with its (j,l) 
entry the set satisfies 


a T jt p) a] v = 0, Vj, l, V G [to], l ? V, (J aj, = {(j - 1)M + 1, ..., jM} , 


(3) 


i=i 

m m 

from which we obtain that Yj r }i = M, for all j G [to], and ^ rf = M , for all l G [to]. 

1=1 j=i 

Therefore, the matrix R r = ( r ^)i,je[m] corresponding to ,4 r has the property that all its entries are positive, rf f 0, and 
the sums of all entries on each row and each column equal M. 

We state this fact in the following lemma. 
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Lemma 9. Let 9 = (Oij) be a non-negative matrix of size m x m and let P = {Pif) £ Pm- Let r £ S m M be a permutation 

on the set [mM} and let A T = }} (0^ P )i r (i) be a permanent-product of . Then, there exists a unique non-negative 

iG[mM] 

integer matrix R T = (rf) of size m x m with the properties 

m 

'52 r 'ji= M > Vj £ [m], (4) 

1=1 
m 

£r5i=M, VZ £ [to], (5) 

3 =1 


such that 


A r 


nn^)-. 


3=11=1 


( 6 ) 


We call the matrix Ii T the exponent matrix of A r . 


C. Decomposing the permanent-products of lifts of matrices 

In this subsection, we present a lemma and an algorithm that allows us to rewrite the permanent-products of a P-lifting of 
9 into a form useful for proving the conjecture, namely, as a product of M permanent-products in 9 that are not necessarily 
distinct. 


Lemma 10. Let 9 = [9 if) be a non-negative matrix of size m X to and let P = (P l: j) £ Pff Let r £ S m M be a permutation 
on the set [mM] and let A T = }} (^ P )i T (i) be a permanent-product of 9^ p . Then, there exists, not necessarily uniquely, 

a set of integers 0 ^ t TCT ^ M such that Y t Ta = AT and 

(T^Sm 

A-t = (^lcr(l)^2cr(2) ' ' ' ^mcr(m)) • (7) 

aCiSm 

Proof: Let R T be the exponent matrix of A T . For each a £ S m , let P a £ V m be the to x to permutation matrix 
corresponding to a and let t Ta = minjr^^j, i • • ■ > r ma(m )} ^ 0- Then R T — t Tcr P a is a positive matrix with the sums 
of all entries on each row and each column equal to M — t Ta and with all its entries equal to the ones on the same positions 
of R t except for the entries corresponding to the permutation o, which decreased by the same amount t Ta . We can index the 
set {<7 £ 5m} = {a/; £ S m , k £ [to!]} and compute sequentially 


R r ,k+1 = Rr,k - t T a k Pa k = Rt ~ k f 2, 

S =1 

k 

where the sums of all entries on each row and each column of R T ,k+ 1 are all equal to M — t T<Ta . Note that after one round 

S= 1 

corresponding to a permutation a, the entries are either the same if t Tcr = 0 or, if t, Ta f 0, at least one non-zero entry in the 
matrix R r (corresponding to t Ta ) gets changed to a zero entry in the matrix f? T fc +1 and all the other entry values on the 
positions corresponding to the permutation <Jk decrease by the same amount t Tak . The algorithm runs until all non-zero entries 
get changed into zero entries, see Example [T2l for an illustration of this process. Consequently, the matrix R— t Tr7 P a = 0. 

crG«S m 

This yields R = traPa, leading to 

<T£Sm 

m m 

a t = n ( @tp )-«=niife) ri,= n 

iG [mM] j=l 1=1 crG»S m 

and t Ta = M. 

crCiSm 

Note that this described decomposition always works, i.e., the steps presented above can be always performed until all 
the entries are changed into zero entries. This is due to the Birkhoff-von Neumann theorem on the decomposition of doubly 
stochastic matrices into a convex combination of permutation matrices that insures that the doubly stochastic matrix jjR t can 
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be decomposed indeed as a convex sum of permutation matrices (f| The decomposition algorithm is basically the one presented 
abovel 1 


Remark 11. In the rest of the paper, we will refer to the algorithm in the proof of Lemma [TO] as the decomposition algorithm. 

□ 

Example 12. Let M = 7 and 9 as in Example 0 and suppose that A r = a 3 b 2 c 2 e 3 f 4 g 4 h 2 i is a product in perm(Y/' p ). Then 
this product corresponds to the following exponent matrix R T and the corresponding matrix 9 Rt = f/ff ) 

( 8 ) 

4 2 1 g 4 h 2 i 1 

Following the algorithm we obtain 

Rt = 



‘3 2 2" 


a 3 b 2 c 2 

Rr = 

0 3 4 

& 

i 

II 

d° e 3 / 4 


4 2 1 


1 

‘(S3 

CN 

05 

_1 


'3 2 2 


'2 [|] 2' 


'2 0 { 2 } 


"[2] 0 o' 

0 3 4 

—» (aei) —>■ 

0 2 4 

( bfg ) 2 -»• 

0 2 2 

( ce d) 2 

0 0 2 

4 2 1 


4 2 0 


2 2 0 


0 2 0 


(afh) 2 


So a 3 b 2 c 2 e 3 f 4 g 4 h 2 i = ( aei)(bfg) 2 (ceg) 2 (afh) 2 


□ 


It can be easily checked that the decomposition in Example [12] is unique. However, this is not always the case. Next we 
show an example where there are 3 possible decompositions. 

Example 13. Let M = 7 and 9 as in Example 0 

Suppose that A K = a 3 b 2 c 2 e 2 f 3 g 2 g 2 h 2 i 3 is a permanent-product in perm(0^ p ) that corresponds to the following exponent 
matrix R K and the corresponding matrix 9 Rk = (b'-f ) 



3 2 2 


a 3 b 2 c 2 

R, = 

2 3 2 

2 2 3 

, 9 r « = 

d 2 e 3 / 2 
g 2 h 2 i 3 


(9) 


Following the algorithm we obtain 


R, = 

3 2 2 

2 3 2 

—>• (aei) 3 —> 

'0 [|] 2 

2 0 2 

-»• Wg) 2 

0 0 2 

2 0 0 


2 2 3 


2 2 0 


0 2 0 


( cdh ) 2 


So a 3 b 2 c 2 e 3 f 4 g 4 h 2 i = (aei) 3 (b f g) 2 (cdh) 2 . 

However, we can also group the entries in the following way: 



3 2 2 


B 2 2l 


0 2 

2 

Rk = 

2 3 2 

—>• (afh) 2 —> 

2 3 0 

—>• (aei) —> 

2 2 

0 


2 [ 2 ] 3 


to 

0 

co 

1 _ 


2 0 

2 


{cegf -»• 


0 0 o’ 
2 0 0 
0 0 2 


( bdi ) 


Rk — 


3 2 2 

2 3 2 

2 |7| 3 


(afh) 


2 2 
3 1 


So a 3 b 2 c 2 e 3 f 4 g 4 h 2 i = (afh) 2 (aei)(ceg) 2 (bdi ) 2 . Similarly, we can also group them in the following way: 

( aei ) 2 


0 2 

2 1 



2 1 3 

'0 0 l' 


2 1 1 
[0 0 l] 


001 

(ceg) -»■ 

2 0 1 

1 1 1 

t 

t 

1 0 1 

110 

( bfg ) 

100 

010 


(cdh). 


So a 3 b 2 c 2 e 3 f 4 g 4 h 2 i = ( afh)(aei) 2 (ceg)(bdi)(bfg)(cdh). It can be easily seen that these three decompositions are the only 
possible ones. □ 

5 A matrix is doubly stochastic if is has positive entries and both its rows and columns sum to 1. 

6 Sec http://staff.science.uva.nl/~walton/Notes/Hall_Birkhoff.pdf for a short presentation of the Birkhoff-von Neumann theorem and the decomposition 
algorithm. 
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Therefore, the decomposition is not always unique, i.e., there are exponent matrices for which the decomposition is unique 
and there are matrices for which the decomposition is not unique. We will refer to a decomposition of an exponent matrix 
obtained by the decomposition algorithm as a standard decomposition of the exponent matrix. Similarly, we will refer to a 
decomposition of a product }} ( 9ji) rjl into some product }} ( 6 , i CT (i) 0 2 cr ( 2 ) • • • # mo -(m)) T ” as a standard decomposition 

j =1 1 = 1 erGSm 

of the permanent-product, as it corresponds to a standard decomposition of the exponent matrix. 


D. Same-index decomposition of a permanent-product 

m m 

The algorithm presented in the proof of Lemma flOl provides a way to decompose the product }} ( 9ji) rjl into a new 

.7-1 /-l 

product }} ( 0 icr(i) 02 cr( 2 ) • ■ but does not tell us exactly how to combine the entries ((fl p ) iT ^ to obtain this 

cr£«S m 

decomposition. Is there a way in which we can algorithmically combine the indices of the sets of to form the products 
(^lcr(l) 9 2a (2) ’'' Oma(m)) tT '’ for all er G <S m ? The answer is yes, as we explain in the next example of a concrete P-lifting of 
9 from Example fl2l with P reduced. 

Before presenting it, let us introduce a new matrix a T = (off) obtained from a T by substituting each index (j — 1 )M + k 
in an entry set by k, k £ [M\. Then the properties (0) of the matrix a T translate into the following properties of the matrix 

(y.'j-. 

m 

tfjl = 0. Y), z, l'€{m], If If U af = [M]. ( 10 ) 

1=1 

The following example uses the matrix a and provides a unique method of combining the indices of to obtain the desired 
decomposition of the product A r . This method follows the steps of the algorithm that we described in Example[T2]for modifying 
the matrix R T . 


Example 14. Let 9 be the 


3x3 matrix in Example [3 P = (P t j) e V% 9^ p and A T = a 2 bdf 2 h 2 i as follows: 


h h I3 


1 

t— 1 

O 

| O 


0 1 o' 

h Q Q 2 

, Q = 

1 0 0 

, Q 2 — 

0 0 1 

1 


0 1 0 


1 0 0 




0 

0 

bi 

0 

0 

Cl 

0 

0 

0 

02 

0 

0 

© 

0 

0 

C2 

0 

0 

0 

03 

0 

0 

b3 

0 

0 

C 3 

di 

0 

0 

0 

0 

ei 

0 

fi 

0 

0 

© 

0 

e-2 

0 

0 

0 

0 

/2 

0 

0 

GZ3 

0 

e 3 

0 

fs 

0 

0 

9 1 

0 

0 


hi 

0 

0 

0 

h 

0 

0 

92 

0 

0 

h 2 

0 

0 

0 

© 

0 

0 

93 

0 

0 

Z1.3 

h 

0 

0 


(ID 


where I 3 denotes the identity matrix of size 3 and the entries boxed in (ITTb (left matrix) correspond to the permutation r that 
gives the product A T = a 2 bdf 2 h 2 i. In (ITT1) (right matrix), we wrote the matrix (T p with its entries indexed by their row, e.g., 
«i = «2 = <73 = a and at is on the ith row of the first block Pn. 

The matrices a T , a T and ll T are 



r { 1 , 3 } 

{ 2 } 

0 


[0 3 

© 

0 


'2 1 0 ’ 

a T = 

{5} 

0 

{4,6} 

, Oi r — 

© 

0 

1 

3 

, Rt = 

1 0 2 


0 

{7,9} 

{ 8 } J 


0 

1 

3 

© J 


0 2 1 


where, for simplicity in writing, we omit the set parentheses in a T . Note that a T corresponds to the row indices of the boxed 
entries in (fTTb (left matrix) that are illustrated through indexed entries in (ITTb (right matrix). In the matrix a T , we use circles, 
boxes and shaded boxes to show how to group the entries of (fTTb (left matrix) that appear in A T , as follows. We group together 


























































entries in ( 7 1P in rows indexed by the circled entries in a T , and we group together entries in 0 rP in rows indexed by the boxed 
entries in a T , thus obtaining a unique rewriting of the product A r as A T = ( afh) 2 (bdi ), in correspondence to the rewriting 
steps of matrix R T . In terms of the indexed entries of 9 ^ p , the above grouping corresponds to A T = (aifihfj^sfzh^ibada^) 
which is exemplified through circles, boxes and shaded boxes in the version of ( 7 ' p with indexed entries in CD (right matrix). 
□ 

Is a decomposition like the one drawn in a T of Example [ 14 ] always possible? The answer is yes due to the following simple 
fact. Each row and column of (A r participates with exactly one element to a permanent-product. In the matrix (f p of ( II 1 1 . 
once we choose d on the second column, or, equivalently, da. none of the entries a2 or <72 on that column can be part of the 
permanent-product anymore and, therefore, the second row of matrix Pn (where a2 is positioned) and the second row of the 
matrix P31 (where g 2 is positioned) must contribute each with exactly one entry other than the entries a2 and <72 that are not 
allowed. These are the boxed entries &2 and <2- We group these entries with da uniquely and continue the same way to group 
each of the a entries with the entries / and h that are on the two rows associated with the other two entries on the columns 
of the entries a to obtain ( a±fihi ) and (03/3/13). 

In terms of the entries of the matrix a T , this corresponds to the grouping we showed in Example fT 4 l because the matrix P 
is reduced, so the first matrices Pn in each row and Py in each column are equal to the the identity matrix, for all l € [m]. 
Therefore, for each of the first M columns, the nonzero entries on the jth column are all positioned on the yth row of the 
matrices Pn, for all l € \m\. Of course, this is not valid for a column that is not among the first M. Indeed, the boxed i of 
0tP in (HD is on row 2 of matrix P33 and has the nonzero entries on rows 3 of matrix Pi3 and 2 of matrix P23. However, 
it still holds that the rows corresponding to these non-zero entries must contribute to the product with one entry exactly that 
cannot be on the column of i. In this case, da on position ( 2 , 2 ) in P21 and 0,3 on position ( 3 , 3 ) of Pn are these entries. 
We can group these together as well. In fact any such grouping of three where two of them are on the rows corresponding 
to the non-chosen entries of the column of the third of the group is a good association; the permanent-product A T is then a 
product of some of these three-products with the property that the entries in the products are taken only once and they cover 
all the entries in the permanent-product A T (i.e., they form a partition). Such a partition is surely given by the three-sets of 
the boxed entries in the first M columns, because each of these sets must be disjoint and they are exactly M, the number of 
boxed entries from the first M columns, so the union of all entries in these products is equal to all entries in the product A T . 
In fact, any three-sets associated to the boxed entries in a set (j — 1 )M + 1 ,.... jM of columns corresponds to a partition of 
the entries in A T . For simplicity, however, we choose the partition corresponding to the first M columns, or, equivalently, to 
the matrix a T . We call this decomposition same-index decomposition. 

Therefore, the same-index decomposition of a permanent-product ‘in (f p is the writing of the permanent-product as a product 
of M sub-products of m entries in 6 each indexed by the same row index, e.g., {aifihijfbadaifjiazfzhf). 


E. The relation between the exponent matrix decomposition and the permanent-product same-index decomposition 

In this section we will revisit the setting of Example [13] in order to understand how the grouping described in Section IH-DI 
determines the type of the decomposition into M products of permanent-products of 9 in the decomposition algorithm of the 
exponent matrix described in Section III-CI 

Example 15. Let M = 7 and let 9 and A K = u :i If c 2 e 2 f 3 g 2 g 2 h 2 i 3 as in Example [13] We saw that there were three possible 
decompositions of A K in permanent-products as follows 

A k = ( afh) 2 (aei)(ceg) 2 (bdi ) 2 = ( afh)(aei) 2 (ceg)(bdi)(bfg)(cdh ) = (aei) 3 (b f g) 2 (cdh) 2 . 


How are these three possible decompositions of the exponent matrix visible in the same-index decomposition of a given 
permanent-product described in Section Hl-DI ? We can assume for simplicity (and without loss of generality) that the exponent 
rn = 3 corresponds to the row indices { 1 , 2 , 3 } of the entries in Pn that appear in A K . We have three possible scenarios for 


how these row indices can be combined with the indices of the entries in 


P22 

P32 


P23 

P33 


with associated exponent matrix 


3 2 
2 3 
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(modulo some permutations of indices) such that the overall exponent matrix is R K : 



These correspond to the following exponent matrices: 


RK,,a 3 e 3 i 3 

'3 

3 

5 -^K,a 3 e 2 fhi 2 

"3 

2 1 

? K,a 3 ef 2 h 2 i 

"3 

1 2 


3 


1 2 


2 1 


The remaining indices are uniquely determined in the way shown in Example [ 13 ] so we omit them from the matrices above. 
Equivalently, we have the following possible same-index decompositions: 


010203 eie2e3 *1*2*3 = (t*iei*i)(a 2 e2* 2 )(**3e3*3) 
010203 6162/3 *1*2/13 = {aieiii)(a 2 e 2 i 2 )(a 3 f 3 h 3 ) 
010203 ei/2/3 iih 2 h 3 = (aiei*i) (02/2/12)(03/3/13) 


Therefore, when fixing the indices of Pn to { 1 , 2 , 3 }, there are 3 non-equivalent ways in which the exponent matrix II K in ([ 9 ]i 
can occur, where by non-equivalent we mean that the matrices a K do not map into each other after applying some permutation 
on the set of row indices [M]. 

However, in the case of A T = a 3 b 2 c 2 d°e 3 f^g^h^i 1 in Example fl 2 l with the exponent R T given in ([U we can only have 


'0® 3 






© 3 


© 3 




(or equivalent matrices) due to the entry of 1 in the position ( 3 , 3 ) of R T and 0 in the position ( 2 , 1 ). Indeed, as explained in 
Section Hl-DI if the entry from P3 3 is, for example, on row 1, the entries on the row 8 (the first of the second row of blocks) 
must contribute to the permanent-product with an entry from the matrices P 2 ,i or P 22 - Since r2i = 0, it implies that the entry 
on the first row of P 2 2 is also in the permanent-product. Similarly, the entry on the first row of p | will also appear in the 
product, and thus we have the unique scenario (modulo permutations) presented above and the product 


aia 2 a 3 ei/2/3 h 2 h 3 h = ( a 1 e 1 i 1 )(a 2 f 2 h 2 ){a 3 f 3 h 3 ). 


□ 


So far, in all our examples the same-index decomposition of a permanent-product is equal to its standard decomposition. In 
the following section, we see that this is not always the case. 


F. Decompositions that contain illegal sub-products 

Note that in Example IT 5 l one of the following decompositions in a K associated with the entry 3 in the position ( 1 , 1 ) of R,- 
could also occur (and their equivalent version): 


"n© 3 




'm® 3 




'm® 3 




"n© 3 




1 © 

3 

) 


3 © 

1 



1 

© 3 



3 

© 1 


LlJ 

© 3 



3 




to© 

3 



3© 



yielding the following permanent-products of (/ p : 

aia 2 a 3 eie 2 / 3 /*i* 2*3 = (aiei/ii) t (a 2 e 2 * 2 )(a 3 /3*3) t = (aiei*3)(a 2 e 2 * 2 )(a 3 / 3 /*i), 
aia 2 a 3 f\e 2 e 3 i\i 2 h 3 = {aifiii)\a 2 e 2 i 2 )(a 3 e 3 h 3 ) ] = (ai/i/* 3 )(a 2 e 2 * 2 )(a 3 e 3 *i), 
**1*1203 61/2/3 /*i/* 2*3 = (**161/*i)^(**2/2/12)((*3/3*3)^ = ( a,ieii 3 )(a 2 f 2 h 2 )(a 3 f 3 hi ), 
**i** 2 **3 e 3 / 2 /i h 3 h 2 ii = {a 2 f 2 h 2 ){a 3 e 3 h 3 )^ = (a 1 f 1 h 3 )(a 2 f 2 h 2 )(a 3 e 3 ii). 
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In this case, not all of the products of 3 entries of the same index correspond to permanent-products in the matrix 9 \ we marked 
with f the ones that do not, for example, (aie\hi)^ corresponds to aeh in 9 which is not a permanent-product. We call such a 
product illegal. This illegal three-product needs to be grouped with another illegal three-product in the same grouping, in this 
case ((13/3*3/, and rearranged as (aiei/3) (<23/3/11) to obtain a standard decomposition, i.e., a product of permanent-products 
of 9 . We call these sub-products that correspond to a permanent-product in 8 legal. 

Example 16. Let 9 the 3 x 3 matrix from Example [ 5 ] let M = 6, and let 



with the entries of the product A T = aia4<25&6C2C3<i2e3e6/i/4/5<73<76^i/i2/i5*4 = a 3 bc 2 de 2 f 3 g 2 h 3 i highlighted in the matrix 
(A r . All entries in a block P, :] are equal to the entry 9 ij, for example, «i = a 2 = 03 = a 4 = a,- = as = a, etc. We use 
the index l for an entry in i/ ; to denote the row position of that entry in P t] , for example, at is on the 4 th row of Pu. 
The indices for the entries are helpful when describing r. We use boxes, shades, circles and bold faced with circles, boxes, 
and shades, respectively, to draw the entries of A T so that the decomposition according to the matrix a T , i.e., the same-index 
decomposition, is visible. This means that all entries in the permanent-product A r of the same index will have the same 
shape/color. The following matrices can be computed. 



'3 1 i 


'® 

4 5 

6 

© j 


R t = 

1 2 3 

, Oi r — 

© 

3 6 

® 4 

5 


2 3 1 



3 

6 

®© 5 

4 



The same-index decomposition corresponding to the grouping of the matrix a T is 

At = (ai/i/li)(d 2 C2/l2)(33C3e 3 )(a4/4 { a 5fbh$)(g§beeG )*• 

Here we have an example in which not all products of 3 entries of the same index in a permanent-product of (A 1 ' are legal, 
i.e., they correspond to permanent-products in the matrix 9 . As before, we marked with f the illegal ones, for example, 
(«i f-t i-t) ' corresponds to afi, which is not a permanent-product in 9 . This three-product needs to be grouped with another 
illegal three-product in the same decomposition and rearranged as follows. 

(a 4 /4*4) t (56Z>6e6) t = (a 4 e 6 *4) (^e/O = (aei)(gbf). 

This results in the following standard decomposition of the permanent-products A T that is not equal to its same-index 
decomposition, i.e., into a product that contains only legal terms, although some of them contain sub-products with indices 
that are not all the same: 

= {aifihi)(d2C2h2){g3C3e3){a4eeu)(a 5 f5h 5 )(g6bef4)- 


□ 
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G. Mapping illegal products into legal products 

In this section we will show that we can always assume that all permanent-products in 0' p are products of 0-permanent- 
products by showing that any permanent-product of (l* p containing some illegal sub-products can be mapped uniquely into some 
product of M same-index permanent-products of 0. In addition, this product has the same exponent matrix as the original 
permanent-product but is not a permanent-product of O' 1 '. This way, we establish a one-to-one correspondence between 
permanent-products of 0 V and products of M permanent-products in 9. 

We revisit Example [16] to exemplify this correspondence. 


Example 17. Let 9 , 0l p and A T be like in Example [16] Recall that the same-index decomposition of A T in Example [16] 
was A t = (t*i/i/*i)( 0262 02) ( 33 ^ 3 ^ 3 ) (** 5/5 0s) (** 4 / 4 * 4 )^ (06 , which contained two illegal sub-products ( 04 / 4 * 4 )^ and 
(<?6&6ee)^ that were combined to obtain ( 046614 ) {gebef 4 ). Note that this combination is unique; no other combination resulting 
in legal sub-products, i.e., in permanent-products in 9, is possible between the two products. Each ^-permanent-products 
( 0466 * 4 ) and ( 56 ^ 6 / 4 ) contains the combined indices 4 and 6. 

Let A’ t = (t*i/i 0 i)( 02 C 2 ^* 2 )(l? 3 C 363 )(t* 5 / 5 L 5 )( 0464 * 4 )(< 76 ^ 5 / 6 ) be the (unique) product of M same-index 0-permanent- 
products starting with 01 , 0 ( 2 , 33 , 04,05 and g^ with the same exponent matrix R r . Map A T n- A' T . We observe that A' t cannot 
be a permanent-product if A T is. Indeed, the two products are equal in all but 2 positions, therefore, if the two were both 

j- ^ 

permanent-products, then 0' p would need to have a 2 x 2 submatrix , which is not allowed as no two e entries (and no 

e6 fd 

two / entries) are on the same row or column (they are entries in eP 22 , respectively, f R> 3 , where P 22 and P 23 are permutation 
matrices). Hence the correspondence A T i-» A' T is an instance of the desired correspondence between the permanent-products 
in 0 1P that have illegal sub-products in their same-index decompositions, and products of M permanent-products in 0 that are 
not permanent-products in 0 1P . In addition, since a permanent-product in 0l p that does not contain any illegal sub-products 
has its same-index decomposition equal to its standard decomposition, it can be mapped trivially into itself. This way, we 
obtain a map from the set of all permanent-products in 0l p into the set of all M products of permanent-products in 0. □ 


This correspondence illustrated in the previous example can be generalized to all permanent-products of 0l p with same-index 
decompositions that contain some illegal sub-products in the following way. 

• Let 0 be an to x to non-negative matrix and (0 P be a reduced matrix of degree M. 

• Let t be a permutation on [mM] and A r be a permanent-product in 0l p that is not trivially zero. Let R T be its exponent 
matrix. 

• Write A r as the same-index decomposition; A r can or not contain illegal same-index sub-products, i.e., products of m 
entries in 0 of the same index that are not permanent-products in 0. 

• List all distinct products of M same-index permanent-products in 0 corresponding to all standard decompositions of ll~ 
that start with the entries in A T that are in the first M columns of 0 1P . Call them A' T 1 ,..., A' T ; and reorder, if needed, 
the entries in the sub-products of A T and A' T ± ,..., A' T t such that the entries from the first M columns are always first in 
the subproduct, followed by the entries ordered by the row index in 0 increasingly from 1 to to and such that the indices 
of the 0-permanent-products are ordered increasingly from 1 to M. 

This procedure, henceforth called standard mapping, is formalized in the following lemma. Several examples can be found in 
Appendix lAl 


Lemma 18 (Standard mapping). Initially, set C := {A' T 1 ,..., A' T l }. 

Let 0 ^ s ^ M and 1 ^ t < m be such that 

• A r and each A' T ? £ C have their first s O-permanent-products equal and 

m A t and each A' T ■ £ C have their (s + 1)0* 9-permanent-products either equal in the first t entries or have all of the first 

t entries distinct except for the first entry and 

• A t and A' T i £ C have their (s + 1)0* 9-permanent-product equal in the (t + 1)0* entry, while there exists A' T • A' T 

such that A t and A' T j have the (s + 1)0* 9-permanent-product distinct in the (t + 1)0* entry. 

Let {A' t ,..., A' t j k } C {A' r 1; ..., A' t ;}, 1 ^ k < l, such that A T and each A' T Jn , n £ [fc], have their (s +1)0* 9-permanent- 

product equal in the (t + 1)0* entry. 

Map A r 1 —y A' t i if k = 1, otherwise update C := Ck and repeat the steps from 


Start 


Start 
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Then, this map is a well-defined one-to-one (injective) map from the set of all permanent products of 0^ p of a certain 
exponent matrix to the set of all products of M 8-permanent-products of the same exponent matrix. This gives a one-to-one 
map from the set of all permanent-products in 0^ p to the set of all products of M 9-permanent-products. 

Proof: The fact that the map is well-defined is easy to see since there can only be one matrix A' t , satisfying the conditions, 
while the existence of this matrix is ensured by the decomposition algorithm presented in Section III-CI Indeed, the exponent 
matrix decomposing algorithm guarantees the existence of the list of products of ^-permanent-product, which has its cardinality 
at least one, and at the same time, guarantees the existence of a standard decomposition of the permanent-product into legal 
sub-products not necessarily of the same index obtained from its same-index decomposition; this can be mapped into a product 
of same-index ^-permanent-products, thus guaranteeing the existence. The fact that no two permanent-products can be mapped 
into the same A' Ti is also ensured by the conditions of the mapping; if two different permanent products A r and A v map into 
the same A ' T then they must have a first entry in which they differ; this entry must be necessarily after the first s entries. 
This means, however, that there must exist an A' T j that shares with A „ that entry but not with A' ri . Therefore, A v cannot 
get mapped into the same A' T , as A r , proving that the function is one-to-one. In addition, if A T contains illegal same-index 
sub-products, then A' T ; such that A r i A' Ti cannot be a permanent-product in 0^ p . To see this, erase from (f T ‘ all rows 
and columns corresponding to the entries that the two share. Suppose that there are k entries in which the two products are 
different, say, xi, x%,..., Xk in A T and x\, xf,, x' k in A' Ti . Because the two products A r ,A' ri have the same exponent 
matrix, so do the two products x\ .x '2 ... Xf- and x\ xf ... x' k . Therefore, in each block in which there exists some x t , i £ [/>;], 
there must exist also a j £ [A;] such that x' is also in that block. We can reorder x'i, x' 2 , ■ ■., x' k so that each x\ is in the same 
block as x\. Note that there can be more entries in one block, but to each entry x; corresponds a unique entry x\ in the same 
block. Since there is only one column in the k xk submatrix crossing the term Xi and since x' cf_ {|,... xt }, we obtain that 
Xi and x'j must be on the same column which contradicts the fact that the block is a weighted permutation matrix. 

Therefore, if A T contains illegal same-index sub-products, then it is mapped through the above mapping into a product A' r i 
that is not a permanent-product in 0^ p . This also implies that an all-legal permanent-product A r and a permanent-product in 
containing some illegal same-index sub-products A K do not map into the same product of M 0-permanent-products, which in 
this case would be A r . Indeed, if A r does not contain any illegal sub-products, i.e., it is a product of M 0-permanent-products, 
then A T = A' t for some i, and the mapping corresponds to A T h-» A T as expected. 

Such a mapping can be defined for each exponent matrix, which proves the existence of the overall one-to-one map from 
the set of all permanent-products in 0 1P to the set of all products of M 0-permanent-products. ■ 


H. Upper bounding the permanent of a lifting of a matrix 

_ m m 

The mapping in Section Hl-GI allows us to compute, for a fixed exponent matrix R = (r^), the coefficient of ]~[ ]~[ ( Oji j r>l 

3=1 i=i 

m m 

in perm(0T p ), or, equivalently, the maximum possible number of permutations r £ S m M such that ^4 T = TT TT {®jlY il ' s a 

3=1 i=i 

permanent-product with exponent matrix R that is not trivially-zero, and, using this, to prove the upper bound perm(0^ p ) 
perm(0) M . 

The following corollary is an immediate consequence of the one-to-one mapping. 


Corollary 19. Let R = (r,j) be an exponent matrix of some permanent-product in perm(0^ p ). For each r £ S m M with 

m m 

A T = II (Oji) rjl ’ i- e t A't i, ■ ■ ■, A't l be the possible products of M O-permanent-products associated with R. For each 
3=1 1=1 

j £ [l], denote by N t j the number of products of M 9-permanent-products that are equivalent to A' T :j , i.e., they can be 

m m 

obtained from A' r ? by applying an M-permutation on the indices. Then, the coefficient of ]~[ i fl perm(0^ p ) is 

3=11=1 


upper bounded by fR N r j. 

3=1 

The following lemma determines the number N t j for all j £ [/]. 

Lemma 20. For each j £ [Z] and a £ S m , let 0 ^ t ha R M such that tj,<? = M and A' t j = ]”[ (0io-(i)02o-(2) ■ • • 0mff(ra)) (l ’” ■ 
Then N T ,j = (^) where j is the multinomial coefficient associated with the vector tj = (tj,a)<reS m ■ 
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Proof: The entries that lie in the first M columns of O' 1 ’ uniquely determine the way the products of 0-permanent-products 
( 0 M1) 6, 2 <t(2) m ))* 3 ’ a are formed. We can choose these in ways. ■ 

The main result of the paper now follows immediately. 

Theorem 21. Let 9 = ( Oij ) be a non-negative matrix of size m x m and let P = (Pif) £ Then 

perm(6» tP ) < perm(6i) M . 

\M 

mg |z.ui anu uit tA.paiiaivjn ui jjcimii/ 

M 


Proof: The upper bound follows immediately from Lemma l20l and the expansion of perm(0) A ' as 


perm(6 l ) M = ^ Slcr(l)^2a(2) ■ ■ • 6ma(m) 


Kcr^Srr 


= E 

|tjl=M 


1^1 (^lo-(l)^2cr(2) ' ' ' ^mcr(m)) 

crG«S m 


In the next example, we illustrate the upper bound for the exponent matrix R = R T in Example fl4l 

Example 22. Let M = 3 , and let 9, (f p , R = R r as in Example [14] and a 2 bdf 2 h 2 i be the product corresponding to R. 
How many permanent-products could exist in (f p that lead to the product a 2 bdf 2 h 2 il Note that R has the unique standard 
decomposition a 2 bdf 2 H 2 i = ( afh) 2 (dbi ). Therefore, by Cor. [19] we expect no more than ( 9 J = 3 permutations 

to result in this product. Indeed, there are exactly three combinations of same-index permanent-products in 9 mapping into 
(■ afh) 2 (dbi ), namely ( a 1 fih 1 )(d 2 b 2 i 2 )(a 3 h 3 f 3 ), (ai/i/ii)(a 2 /i 2 / 2 )(d 3 63 * 3 ) and (di&iii)(a 2 / 2 /i 2 )(a 3 /i 3 / 3 ), giving 3 possible 
products of M = 3 permanent-products in 9 with the standard decomposition ( afh) 2 (dbi ), i.e., a maximum of Ni = = 3 

possible products. 

Note that, in fact, all three above products of permanent products in 9 are valid permanent-products in tL p , resulting in 
the coefficient of a 2 bdf 2 h 2 i being equal to the upper bound 3. One of these products was A T = 01 ^ 203 ^- 1 ^ 2 ^- 3 / 3 / 1*2 = 
(ai/i/ii)(d 2 h 2 * 2 )(a 3 /i 3 / 3 ) = a 2 bdf 2 h 2 i of Example [14] 

Let us now compute the maximum coefficient of abodefghi in (f F . Observe that its exponent matrix has two possible 
standard decompositions: ( afh){ceg)(bdi ) and ( aei)(bf g){csh ). Therefore, the maximum possible coefficient of abode fghi in 
perm(6^ p ) is equal to the sum of two equal multinomial coefficients associated with the vector (1,1,1), i.e., ( 1 i 1 ) + ( 1 i 1 ) = 
2TTTTTT = 12. The actual coefficient of abcdefghi in perm(#) M is 0, which satisfies the upper bound trivially. 

In Example [30] in Appendix iBl we used Maple to compute the actual permanent of (f F . We also expanded (perm(0)) 3 to 
illustrate the upper bound. □ 

I. Bounding the degree M-Bethe and Bethe permanents 

The bound penn(Y/ p ) ^ perm(0) J ' / gives the following inequality conjectured in JT1 by applying the bound to the permanent 
of each of the M-lifts of 9, and hence also to their average, and then taking the Mth root. 

Theorem 23. Let 9 = (f/j) be a non-negative matrix of size m x m and M ^ 1 an integer. Then 

perm BjM (6») < perm(6 l ). 

Taking the limit we obtain the following theorem. 

Theorem 24. Let 9 = ( 9ij ) be a non-negative matrix of size m x m and M ^ 1 an integer. Then 

perm B (9) < perm B M (6>) < perm(6>). 

Note that the inequality perm B (9) f perm (9) was proved by Gurvits in j2l using a very different method. Our proof is a 
simple alternative that uses only the combinatorial definition of the Bethe permanent. 

III. Conclusions 

In this paper we proved two related conjectures posed by Vontobel in JD on the permanent of an Af-lift O' 1 ’ of a matrix 9 
and on the degree M Bethe permanent perm MB (0) of 9. namely, we show that perm(0^ p ) ^ perm(6 l ) J ' / and, consequently, 
that perm(0) of 9 , i.e., perm MB (0) ^ perm(6 l ). As a corollary, our proof of these conjectures provides an alternative proof 
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of the inequality perm B (0) ^ perm( 0 ) on the Bethe permanent of the base matrix 9, one that uses only the combinatorial 
Definition |2] of the Bethe permanent from JT|. The first proof was given by Gurvits in J2). 

The consequences of the results in this paper are more than just purely theoretical. Apart from showing that it is possible to 
give a purely combinatorial proof that perm B (( 9 ) ^ perm( 7 !) on the Bethe permanent of the base matrix 9 (the earlier proof (2| 
used different techniques), they provide new insight into the structure of the permanent of a P-lifting of a matrix, which can 
be exploited algorithmically to decrease the computational complexity of the permanent of the P-liftings. Such an algorithm 
can search for products of groups of entries formed according to the decompositions presented in this paper to check if they 
form valid permanent-products. 

In addition, the structure of the permanent-products of P-liftings of a matrix may have some implications on the constant 
C in the inequality perm( 0 ) ^ C ■ perm B ( 0 ) in the conjectures stated by Gurvits in (2) . Lastly, since a P-lifting of a matrix 9 
corresponds to an M-graph cover of the protograph (base graph) described by 9, which, in turn, correspond to LDPC codes, 
these results may help explain the performance of these codes through the techniques presented in |28l and extended and 
refined in I29l - l34j for upper bounding the minimum Hamming distance and the minimum pseudo-weight 8351 of a binary 
linear code that is described by an m x n parity-check matrix H. This is done based on explicitly constructing codewords and 
pseudo-codewords with components equal to determinants or permanents of some m x m submatrices of H over the binary 
field or the ring of integers. 
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Appendix A 

Examples of standard mapping 

In this appendix, we illustrate the standard mapping from Lemma [18] by a few diverse examples. 


Example 25. Let m = 3, M = 2, and 9 = {0 i:l ) as in Example [5] and let (l' p be defined as follows: 


0l p 




( 12 ) 


where in (IT2l (left matrix) we highlighted the permanent product A T = (aieihiY (a 2 f 2 i 2 )'' ! = ( aei)(afh ) and in (fl2l (right 
matrix) we highlighted the permanent product A K = ( 01 / 1 ( 1 ) 1 ( 0262 / 12 )^ = ( aei){afh ). These are both products of two illegal 
sub-products and have the same exponent matrix. In order to map these products, we need to list the possible same-index 
decompositions for the two products: 


A t , 1 — (aie 1 i 1 )(a 2 f 2 h 2 ), 

At, 2 — (aifih 1 )(a 2 e 2 i 2 ) 

and 

A k ,i = (a 1 e 1 i 1 )(a 2 f 2 h 2 ), 

An, 2 = ( aifihi){a 2 e 2 i 2 ). 

Note that A T/I = A K , t . for all ( =1.2. Note also that the products are indexed from 1 to M = 2 and that the entries in the 
sub-products are listed from top row to bottom row. 

Then A T 1 —>■ (aieiii)(ci 2 / 2 /i 2 ) and A K 1 — > (aifihi)(a 2 e 2 i 2 ) because the first product ( a\e\hi ) of A T has its first two entries 
equal to those of (aieiii) and the first product (cii/i*i) of A K has its first two entries equal to those of (ai/i/ii). □ 
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Example 26. Let m = 5, M = 3, and let 
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0 
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0 
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© 

0 
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0 

0 
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d>2 

0 
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0 

0 

Xl 

0 

0 

pi 

0 

U2 

0 

V2 

0 

0 

© 

0 

0 

X 2 

0 

0 

92 

0 

0 

0 

0 

U3 

0 

V 3 

0 

6 

W 3 

0 

0 

x 3 

0 

0 

93 

0 


with the entries of the product A r = a 2 a 3 dihii 3 j 2 hl 2 hPi r 2 t 3 u’ 2 X 3 yi = a 2 dhijl 3 prtwxy highlighted in the matrix 9^ p . All 
entries in a (i,j) block are equal to the entry 0 l3 , for all l £ [3], e.g., «i = a, 2 = «3 = a , where the index denotes the row 
position of that entry in Py, for example, u/> is on the 2nd row of al\ \. The following matrices can be computed: 


R T 


2 0 0 1 0 
0 0 111 
0 3 0 0 0 
10 10 1 
0 0 111 


which gives the same-index decomposition A T = 


' (D 3 

0 

0 

0 

0 

0 

0 

1 

3 

© 

0 

1 (2) 3 

0 

0 

0 


1 

0 

© 

0 

3 


0 

0 

© 

3 

1 


{pid 1 hiliyi){a 2 j2kr2W2) ] { a 3.hhtzx?,) ] ■ 


(13) 


The following is the list of possible same-index products of permanent-products of 8 that have the exponent matrix R T : 


A T , i = (pidihihyi)(a2j2l2r2X2)(a3i3ht3W3) ) 
Ar, 2 = (pidih 1 l 1 y 1 )(a2i2l2t2W2)(a3j3l 3 r 3 x 3 ), 
At, 3 = (Pidijihwi)(a 2 i2l2r2y2)(a 3 h 3 l 3 t 3 x 3 ), 
A t ,4 = (pid 1 jiliWi)(a 2 h2l2t2X2)(a 3 i 3 l 3 r 3 y 3 ). 


The first term (d 3 hilipiyi) of A r is equal to the first term of A r ,i and A t ,2 and not equal to the first term of A t , 3 and 
A t , 3 . The second term (V has the first three terms equal to the first three terms of both (c^j^ri^) of A tA and 
(02*2(2(2^2) °f A t ,2 and the forth term is equal to that of (a 2 j 2 h^ 2 X 2 ) of A tA and not equal to that of (02*2(2(2^2) of 
A r ,2- Therefore, we map A r 1 —y A T ,\. Note that A t \ cannot be a permanent-product in (A 1 ' (otherwise we would have a 2 x 2 
sub-matrix of 0f p with X 2 and x 3 on the same column). □ 
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Example 27. Let us now take Ay = aia 3 d 2 hii 3 j 2 hl 2 hP 2 Xit 3 w 3 X 2 yi = a 2 dhijl 3 prtwxy illustrated through the highlighted 
entries in the matrix 


'E 

0 

0 

d\ 

0 

0 

Cl 

0 

0 

di 

0 

0 

ei 

0 

0 


0 

02 

0 

0 

b 2 

0 

0 

C2 

0 

0 

(W) 

0 

0 

e 2 

0 

0 

0 

03 

0 

0 

b 3 

0 

0 

C3 

0 

0 

d 3 

0 

0 

e3 

h 

0 

0 

0 

0 

9i 

0 

0 

hi 

ii 

0 

0 

0 

ji 

0 

0 

h 

0 

92 

0 

0 

0 

h 2 

0 

0 

*2 

0 


0 

0 

0 

0 

h 

0 

93 

0 

h 3 

0 

0 

0 

0 

*3 

0 

0 

33 

ki 

0 

0 

0 

0 

h 

0 

mi 

0 

n\ 

0 

0 

0 

Ol 

0 

0 

&2 

0 

(h) 

0 

0 

0 

0 

m 2 

0 

n 2 

0 

0 

0 

02 

0 

0 

k 3 

0 

h 

0 

m 3 

0 

0 

0 

0 

n 3 

03 

0 

0 

Pi 

0 

0 

0 

0 

9i 


0 

0 

Si 

0 

0 

0 

0 

ti 

0 

© 

0 

<?2 

0 

0 

0 

T 2 

0 

0 

S 2 

0 

t 2 

0 

0 

0 

0 

P3 

0 

93 

0 

0 

0 

r 3 

0 

0 

S3 

0 

t 3 

0 

Ml 

0 

0 

0 

0 

Vl 

0 

0 

Wi 

0 

0 

Xi 

0 

0 

yi 


0 

«2 

0 

V 2 

0 

0 

W 2 

0 

0 

® 

0 

0 

92 

0 

0 

0 

0 

U 3 

0 

V3 

0 

0 

VJ3 

0 

0 

X 3 

0 

0 

93 

0 



A 1 has the same exponent matrix R T in (IT3l > and the index-matrix 


Q 3 

0 

0 

© 

0 

0 

0 

1 

3 

© 

0 

1 3 

0 

0 

0 

© 

0 

1 

0 

3 


0 

0 

3 

© 

1 



which gives the same-index decomposition Ay = (aihiliriyi)'(p 2 d 2 j 2 fax 2 )( 0 ‘ 3 i 3 l 3 t 3 w 3 ). The set associated with Ay is 

Ay,i — {aih\ht\x\){p2d2j2hw2){a3i3l3r3y3,), 

Ay ,2 = (a 1 iil 1 r 1 yi)(p2d2j2l2W2){a 3 h 3 l 3 x 3 t 3 ), 

A 7 , 3 = {a 1 i 1 l 1 tiw 1 )(p2d2h 2 l2y2){a 3 j 3 l 3 r 3 x 3 ), 

Ay,4 = {aijihriXi){p 2 d 2 h 2 l 2 y 2 ){.a 3 i 3 l 3 t 3 W 3 ). 


We see that Ay i->- Ay, \ since the products (aihihriyi) and ( a\hil\tiXi ) have the first 3 entries in common. Note that Ay, i 
is not a permanent-product. □ 

Example 28. Let m = 5, M = 3, 9 and d^ p be as in Example [26] Let A K = p\a2U 3 g2l 3 d 3 eigih 3 n20ir2r 3 X2yi = 
{j>i^i 9 iO\yi)^{a 2 g 2 ’n 2 'f 2 ^ 2 y iu 3 d 3 h 3 l 3 r 3 )^ = adeg 2 hlnopr 2 uxy as highlighted below, together with its exponent matrix and 
its index matrix. 
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R 


K 


10 0 11 
0 2 10 0 
0 10 11 
1 0 2 0 0 
10 0 11 


The set associated with A K is 


r© 

0 

0 

3 

1 

0 

1 © 


3 


0 

0 

0 

3 


0 

© 

1 

1 

0 

© 

3 

0 

0 

3 

0 

0 

© 

1 


A Kt i = {pid 1 h 1 l 1 yi)(a2g202r2X2){u 3 e 3 g 3 n 3 r 3 ), 
A k ,2 = (pieih 1 l 1 Xi)(a 2 g2n2r2y2)(u 3 d 3 g 3 o 3 r 3 ). 


( 14 ) 


We see that A K i-> A K> 2 since the products (pieigioiyi) and (piei/iiZiaii) and have the first 2 entries in common while 
(pieigioiyi) and (pidihiliyi) do not. Note that A K> 2 is not a permanent-product. □ 

Example 29 . Let m = 5 , M = 3 , 6 and 



(as in Example [ 26 l). Lastly, let 

A v = Pia2U 3 g 2 l 3 d 3 eigih 3 n20ir2r 3 X2yi = {pidigiorXi) ] {a2g2n2r 2 y2){u 3 e 3 h 3 l 3 r 3 ) ] = adeg 2 hlnopr 2 uxy , 


which is the product highlighted in (fl 5 l >. 
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The exponent matrix of A v is R v = R K , its index matrix is 


© 

0 

0 


1 


3 

0 

1 

© 

3 


0 

0 

0 


3 

0 

© 

1 

1 

0 

© 

3 

0 

0 

3 

0 

0 


1 


©J 


and the associated set of products A „ is 

A u ,\ = (pid 1 h 1 liy 1 )(a 2 g202r2X2)(u3e3g3n3r 3 ) = A K>1 , 
A„,i = (Pie 1 h 1 lix 1 )(a2g2n2r2y2){u 3 d 3 g303r3) = A K:2 . 


(16) 


We see that A v i —> A Kt ± since the products ( p\digiOiX \) and ( pidihRiyi ) have the first 2 entries in common while 
{pidigiO\X \) and ( pie\h\lixi ) do not. Note that A K _\ is not a permanent-product. □ 


Appendix B 

Example for permanent bounds 
Here we give an example comparing perm((fl p ) with (perm(0)) 3 . 

Example 30. Computing perm(0l p ) we get 

perm(0l p ) = a 3 e 3 i 3 + a 3 f 3 h 3 + 3 a 2 bdf 2 h 2 i + 3 a 2 bf 3 gh 2 + 3 a 2 cde 2 hi 2 + 3 a 2 ce 2 fghi + 3 ab 2 d 2 fhi 2 

+ 6 ab 2 df 2 ghi + 3 ab 2 f 3 g 2 h + 3 abode 2 gi 2 + 3 abce 2 fg 2 i + 3 ac 2 d 2 eh 2 i + 3 ac 2 defgh 2 + b 3 d 3 i 3 
+ 3 b 3 d 2 fgi 2 + 3 b 3 df 2 g 2 i + b 3 f 3 g 3 + 3 bc 2 d 2 eghi + 3 bc 2 defg 2 h + c 3 d 3 h 3 + c 3 e 3 g 3 . (17) 

Computing (perm(0)) 3 , we can easily verify that all the products in perm(0l p ) appear in (perm(0)) 3 with a larger or equal 
coefficient, as predicted by Theorem l2ll 

(perm(0)) 3 = (aei + afh + bdi + bfg + cdh + egc) 3 = aei 3 + 3 aei 2 afh + 3 aei 2 bdi + 3 aei 2 bfg + 3 aei 2 cdh 
+ 3 aei 2 egc + 3 aei afh 2 + 6 aei afh bdi + 6 aei afh bfg + 6 aei afh cdh + 6 aei afh egc 
+ 3 aei bdi 2 + 6 aei bdi bfg + 6 aei bdi cdh + 6 aei bdi egc + 3 aei bfg 2 + 6 aei bfg cdh + 6 aei bfg egc 
+ 3 aei cdh 2 + 6 aei cdh egc + 3 aei egc 2 + afh 3 + 3 afh 2 bdi + 3 afh 2 bfg + 3 afh 2 cdh + 3 afh 2 egc 
+ 3 afh bdi 2 + 6 afh bdi bfg + 6 afh bdi cdh + 6 afh bdi egc + 3 afh bfg 2 +6 afh bfg cdh +6 afh bfg egc 
+ 3 afh cdh 2 + 6 afh cdh egc + 3 afh egc 2 + bdi 3 + 3 bdi 2 bfg + 3 bdi 2 cdh + 3 bdi 2 egc + 3 bdi bfg 2 
+ 6 bdi bfg cdh + 6 bdi bfg egc + 3 bdi cdh 2 + 6 bdi cdh egc + 3 bdi egc 2 + bfg 3 + 3 bfg 2 cdh 
+ 3 bfg 2 egc + 3 bfg cdh 2 + 6 bfg cdh egc + 3 bfg egc 2 + cdh 3 + 3 cdh 2 egc + 3 cdh egc 2 + egc 3 . 

□ 


References 

[1] P. O. Vontobel, “The Bethe permanent of a non-negative matrix,” IEEE Trans. Inf. Theory, vol. 59, pp. 1866-1901, Mar. 2013. Available online at 
http://arxiv.Org/abs/l 107.4196 

[2] L. Gurvits, “Unleashing the power of Schrijver’s permanental inequality with the help of the Bethe Approximation,” ArXiv e-prints, June 2011. 

[3] B. Huang and T. Jebara, “Approximating the Permanent with Belief Propagation,” ArXiv e-prints, Aug. 2009. 

[4] M. Chertkov and A. B. Yedidia, “Computing the Permanent with Belief Propagation,” ArXiv e-prints, July 2011. 

[5] H. Mine, Permanents. Addison-Wesley, Reading, Mass., 1978. 

[6] H. Mine, “Theory of permanents,” Linear and Multilinear Algebra, vol. 21, no. 2, pp. 109-148, 1987. 

[7] H. J. Ryser, “Combinatorial mathematics (Cams Mathematical Monographs No. 14),” Mathematical Association of America, 1963. 

[8] L. Valiant, “The complexity of computing the permanent,” Theor. Comp. Sc., vol. 8, no. 2, pp. 189-201, 1979. 

[9] P. Dagum, M. Luby, M. Mihail, and U. Vazirani, “Polytopes, permanents and graphs with large factors,” in Proceedings of the Twentyninth IEEE 
Symposium on Foundations of Computer Science, pp. 412-421, 1988. 

[10] B. Codenotti, J. D. Shparlinski, and A. Winterhof, “On the hardness of approximating the permanent of structured matrices,” Computational Complexity, 
vol. 11, no. 3-4, pp. 158 - 170, 2002. 

























19 


[11] N. Metropolis, M. L. Stein, and P. R. Stein, “Permanents of cyclic (0,1) matrices,” J. Combin. Theory Ser., vol. B, no. 7, pp. 291-321, 1969. 

[12] H. Mine, “Recurrence formulas for permanents of (0,l)-circulants,” Linear Algebra and its Applications, vol. 71, pp. 241-265, 1985. 

[13] H. Mine, “Permanental compounds and permanents of (0,l)-circulants,” Linear Algebra and its Applications, vol. 86, pp. 11-42, 1987. 

[14] B. Codenotti, V. Crespi, and G. Resta, “On the permanent of certain (0, 1) Toeplitz matrices,” Linear Algebra and its Applications, vol. 267, pp. 65-100, 
1997. 

[15] B. Codenotti and G. Resta, “On the permanent of certain circulant matrices,” Algebraic combinatorics and computer science, pp. 513-532, 2001. 

[16] B. Codenotti and G. Resta, “Computation of sparse circulant permanents via determinants,” Linear Algebra and its Applications, vol. 355, no. 1-3, 
pp. 15-34, 2002. 

[17] A. Bernasconi, B. Codenotti, V. Crespi, and G. Resta, “How fast can one compute the permanent of circulant matrices?,” Linear Algebra and its 
Applications, vol. 292, no. 1-3, pp. 15-37, 1999. 

[18] N. Ruozzi, “The Bethe partition function of log-supermodular graphical models,” CoRR, vol. abs/1202.6035, 2012. 

[19] C. Greenhill, S. Janson, and A. Rucinski, “On the number of perfect matchings in random lifts,” Comb., Prob., and Comp., vol. 19, pp. 791-817, Nov. 
2010. 

[20] M. Bayati and C. Nair, “A rigorous proof of the cavity method for counting matchings,” in Proc. 44th Allerton Conf. on Comm., Control, and Computing, 
(Monticello, IL, USA), Sep. 2006. 

[21] M. Bayati, D. Shah, and M. Sharma, “Max-product for maximum weight matching: convergence, correctness, and LP duality,” IEEE Trans. Inf. Theory, 
vol. 54, pp. 1241-1251, Mar. 2008. 

[22] S. Sanghavi, D. Malioutov, and A. Willsky, “Belief propagation and LP relaxation for weighted matching in general graphs,” IEEE Trans. Inf. Theory, 
vol. 57, pp. 2203-2212, Apr. 2011. 

[23] P. Dagum and M. Luby, “Approximating the permanent of graphs with large factors,” Theoretical Computer Science, vol. 102, no. 2, pp. 283-305, 1992. 

[24] M. Jerrum, A. Sinclair, and E. Vigoda, “A polynomial-time approximation algorithm for the permanent of a matrix with nonnegative entries,” J. ACM, 
vol. 51, pp. 671-697, July 2004. 

[25] J. S. Yedidia, W. T. Freeman, and Y. Weiss, “Constructing free-energy approximations and generalized belief propagation algorithms,” IEEE Trans. Inf. 
Theory, vol. 51, pp. 2282-2312, July 2005. 

[26] J. Thorpe, “Low-density parity-check (LDPC) codes constructed from protographs,” IPN Progress Report, vol. 42-154, pp. 1-7, 2003. 

[27] R. A. Brualdi, “Permanent of the direct product of matrices,” Pacific Journal of Mathematics, no. 3, 1966. 

[28] D. MacKay and M. Davey, “Evaluation of Gallager codes for short block length and high rate applications,” in Codes, Systems, and Graphical Models, 
vol. 123 of The IMA Vol. in Math, and Applications, pp. 113-130, Springer New York, 2001. 

[29] R. Smarandache and P. O. Vontobel, “Quasi-cyclic LDPC codes: Influence of proto- and Tanner-graph structure on minimum Hamming distance upper 
bounds,” IEEE Trans. Inform. Theory, vol. 58, pp. 585-607, Feb. 2012. 

[30] R. Smarandache and P. O. Vontobel, “Absdet-pseudo-codewords and perm-pseudo-codewords: definitions and properties,” in IEEE Intern. Symp. on 
Inform. Theory, (Seoul, Korea), June 2009. 

[31] B. K. Butler and P. H. Siegel, “Bounds on the Minimum Distance of Punctured Quasi-Cyclic LDPC Codes,” ArXiv e-prints, Jan. 2012. 

[32] Y. Wang, S. C. Draper, and J. S. Yedidia, “Hierarchical and High-Girth QC LDPC Codes,” ArXiv e-prints, Nov. 2011. 

[33] H. Park, S. Hong, J.-S. No, and D.-J. Shin, “Design of Multiple-Edge Protographs for QC LDPC Codes Avoiding Short Inevitable Cycles,” ArXiv 
e-prints, Oct. 2012. 

[34] H. Park, S. Hong, J.-S. No, and D.-J. Shin, “Protograph design with multiple edges for regular QC LDPC codes having large girth,” in IEEE Intern. 
Symp. on Inform. Theory, pp. 918-922, 2011. 

[35] N. Wiberg, Codes and Decoding on General Graphs. PhD thesis, Linkoping University, Sweden, 1996. 



